Computer Based Assessment: 
Exams in the Cloud

Maik Meusel | maik.meusel@business.uzh.ch

University of Zurich, Switzerland

CellPrint[TextCell[Framed[Column[{Style["    Abstract",Italic,20,FontFamily->"Helvetica"],"",Style["      In this hands-on presentation participants are invited to attend in an exam which is conducted live and deployed in the cloud. The exam is individualized, randomized, and will contain various types of questions. After completing the exam the grading is done automatically and participants receive a detailed performance feedback. ",13,FontFamily->"Helvetica Light"],"",Style["      This presentation aims to show how cloud based applications can enhance the efficiency of assessment for higher education - especially in courses with large numbers of students. Furthermore, it discusses how commonly used question types are translated into a computer based assessment framework. ",13,FontFamily->"Helvetica Light"]},Alignment->Left],Background->Lighter[LightGray],FrameMargins->{{20,40},{30,20}}],"Output",CellMargins->{{60,40},{30,20}}]]

Why Computer Based Assessment?

DynamicModule[
(* Local variables *)
{n,
list={
{"N°1","Nobody likes grading by hand. \n And it takes very long.",Orange},
{"automatic grading",Orange},
{"N°2","Usually, only one unique solution \n is accepted as a correct answer.",Darker@Green},
{"multiple solutions",Darker@Green},
{"N°3","It needs huge efforts \n  to prevent cheating.",Darker@Pink},
{"individualization",Darker@Pink},
{"N°4","Timing can be complicated.",Darker@Blue},
{"fair timing",Darker@Blue},
{"N°5","Lots of paper is \"wasted\".",Darker@Yellow},
{"paperless exams",Darker@Yellow}},
MakeHypothesisGraphic
},

(* Module *)
Dynamic@ MakeHypothesisGraphic[n],

(* Options *)
Initialization:>(
n=0;

MakeHypothesisGraphic[nr_]:=
If[nr==0,

Framed[
Graphics[
Text@Row@
{
Column[
{
"",
Style["⚠",120,Red,FontFamily->"Symbol"],
"",
Style["Shortcomings \n in paper based assessment",White,30,FontFamily->"Chalkduster"],
Button[Style["▸",FontFamily->"Symbol",White,200],n=1,Appearance->None]
},
(* Column Alignment *){Center,Center,Left},(* Column Spacing *)2.81
]
},
(* Graphics Options *)
Frame->False,ImageSize->{700,525}
],
(* Framed Options *)
RoundingRadius->25,
Background->RGBColor[0,.191,0]
],

If[OddQ[nr],
(* If true *)
Framed[
Framed[
Graphics[
Text@Column[
{
Style[list[[nr,1]],list[[nr,3]],70,FontFamily->"Chalkduster",Italic],
Style[list[[nr,2]],FontFamily->"Gill Sans Light",30,Italic,Darker@Gray],
Row@
{
Button[Style["< ",FontFamily->"Gill Sans Light",If[n==n-1,White,Gray],30],n=n-1,Appearance->None],
"",
Button[Style[" >",FontFamily->"Gill Sans Light",Gray,30],n=n+1,Appearance->None]
}
},
(* Column Alignment*){Center},(* Column Spacing *)10
],
(* Graphics Options *)
Frame->False,
ImageSize->{700-2*35,525-2*35}
],
(* Framed Options *)
RoundingRadius->25,
Background->White,
ImageMargins->35,
FrameStyle->list[[nr,3]]
],
RoundingRadius->25,
Background->list[[nr,3]]
],

(* If false *)
Framed[
Graphics[
Text@Row@
{"           ",
Style["💡",80,Red,FontFamily->"Symbol"],
"                                   ",
Column[
{
"","",
Style[list[[2,1]],White,30,FontFamily->"Chalkduster",Italic],
Style[list[[4,1]],If[nr<4,RGBColor[0,.191,0],White],30,FontFamily->"Chalkduster",Italic],
Style[list[[6,1]],If[nr<6,RGBColor[0,.191,0],White],30,FontFamily->"Chalkduster",Italic],
Style[list[[8,1]],If[nr<8,RGBColor[0,.191,0],White],30,FontFamily->"Chalkduster",Italic],
Style[list[[10,1]],If[nr<10,RGBColor[0,.191,0],White],30,FontFamily->"Chalkduster",Italic],
"","","","",
Row@
{
Spacer[66],
Button[Style[" < ",FontFamily->"Gill Sans Light",White,30],n=n-1,Appearance->None],
If[n<10,Button[Style[" >",FontFamily->"Gill Sans Light",White,30],n=n+1,Appearance->None],""]
}
},
(* Column Alignment *){Left,Center,Left},(* Column Spacing *)0.99
]
},
(*Graphics Options *)
Frame->False,
ImageSize->{700,525}
],
(* Framed Options *)
RoundingRadius->25,
Background->RGBColor[0,.191,0]
]

]])
]

CBA Solution1: Desktop Exams

Row[{Button[Style["Desktop Exam Example",20],SystemOpen["Desktop/EM2013FEC.1123835.Hofstetter_Patrick.nb"]],
Button[Style["Reporting",20],SystemOpen["Desktop/EM2013_FinalGrades.nb"]]}]

CBA Solution 2: Online Exams

Hyperlink[Style["applied.services/wtc2014",40], "http://www.applied.services/wtc2014"]

Reporting

AssessmentOverview

Row[{Button["Report created in Mathematica",SystemOpen@"Desktop/AssessmentReport_Examinee#1.pdf"],Button["Report in the cloud",SystemOpen@"https://www.wolframcloud.com/objects/user-6d74fed6-6f34-48d9-83e9-2f692b3b4e54/Reports/AssessmentReport_Examinee1.pdf"]}]

How many CloudCredits have we consumed?

t0=$CloudCreditsAvailable

t1=$CloudCreditsAvailable

How Online Exams enhance assessment

Discussion: What‘s next?

mathematical proofs (→ more question types)

automatic grading of text input (→ machine learning)

Smart Exams (→ peformance adopting)

further improvement of performance/features of the cloud (→ Wolfram)

computer based authentication (→ Apple Pay?)